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Abstract 



Non-uniform B-spline dictionaries on a compact interval are discussed. For each given 
partition, dictionaries of B-spline functions for the corresponding spline space are con- 
pL| ■ structed. It is asserted that, by dividing the given partition into subpartitions and joining 

r-j ! together the bases for the concomitant subspaces, slightly redundant dictionaries of B- 

splines functions are obtained. Such dictionaries are proved to span the spline space asso- 
ciated to the given partition. The proposed construction is shown to be potentially useful 
for the purpose of sparse signal representation. With that goal in mind, spline spaces 
specially adapted to produce a sparse representation of a given signal are considered. 

^ ■ 1 Introduction 

q , 

qq ! A representation in the form of a linear superposition of elements of a vector space is said to be 
O \ sparse if the number of elements in the superposition is small, in comparison to the dimension 
of the corresponding space. The interest for sparse representations has enormously increased 
the last few years, in large part due to their convenience for signal processing techniques and 
the results produced by the theory of Compressed Sensing with regard to the reconstruction 
of sparse signals from non-adaptive measurements [1-5]. Furthermore, the classical problem 
of expressing a signal as a linear superposition of elements taken from an orthogonal basis 
has been extended to consider the problem of expressing a signal as a linear superposition of 
elements, called atoms, taken from a redundant set, called dictionary [6]. The corresponding 
signal approximation in terms of highly correlated atoms is said to be highly nonlinear and 
has been proved relevant to signal processing applications. Moreover, a formal mathematical 
setting for highly nonlinear approximations is being developed. As a small sample of relevant 
literature let us mention [7-9]. 

In regard to sparse approximations there are two main problems to be looked at; one is in 
relation to the design of suitable algorithms for finding the sparse approximation, and other the 
construction of the dictionaries endowing the approximation with the property of sparsity. In 
this communication we consider the sparse representation matter for the large class of signals 
which are amenable to satisfactory approximation in spline spaces [10,11]. Given a signal, we 
have the double goal of a) finding a spline space for approximating the signal and b) constructing 
those dictionaries for the space which are capable of providing a sparse representation of such a 
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signal. In order to achieve both aims we first discuss the construction of dictionaries of B-spline 
functions for non-uniform partitions, because the usual choice, the B-spline basis for the space, 
is not expected to yield sparse representations. 

In a previous publication [12] a prescription for constructing B-spline dictionaries on the 
compact interval is advised by restricting considerations to uniform partitions (cardinal spline 
spaces). Since our aim entails to relax this restriction, we are forced to look at the problem 
from a different perspective. Here we divide the partition into subpartitions and construct 
the dictionary by joining together the bases for the subspaces associated to each subparti- 
tion. The resulting dictionary is proved to span the spline space for the given non-uniform 
partition. Consequently, the uniform case considered in [12] arises as a particular case of this 
general construction. The capability of the proposed nonuniform dictionaries to produce sparse 
representations is illustrated by a number of examples. 

The letter is organized as follows: Section 2 introduces splines spaces and gives the necessary 
definitions. The property of splines spaces which provides us with the foundations for the 
construction of the proposed dictionaries is proven in this section (c.f. Theorem 2). For a fixed 
partition, the actual constructions of non-uniform B-spline dictionaries is discussed in Section 
3. Section 4 addresses the problem of finding the appropriate partition giving rise to the spline 
space suitable for approximating a given signal. In the same section a number of examples are 
presented, which illustrate an important feature of dictionaries for the adapted spaces. Namely, 
they may render a very significant gain in the sparseness of the representation of those signals 
which are well approximated in the corresponding space. The conclusions are drawn in Section 
5. 

2 Background and notations 

We refer to the fundamental books [13-15] for a complete treatment of splines. Here we simply 
introduce the adopted notation and the basic definitions which are needed for presenting our 
results. 

Definition 1. Given a finite closed interval [c, d] we define a partition of [c, d] as the finite set 
of points 

A := {xjj^g 1 ) N € N, such that c = Xq < X\ < ■ ■ ■ < Xn < Xn+i = d. (1) 

We further define N subintervals Ii,i = 0, . . . , N as: Ii = [xi, Xi+i), i = 0, . . . , N — 1 and 
In 

Definition 2. Let U m be the space of polynomials of degree smaller or equal to m G No = 
N U {0}. Let m be a positive integer and define 

S m (A) = {feC m ~%d] : /| /i en ro _ 1 ,i = 0,...,JV}, (2) 

where f\i i indicates the restriction of the function f on the interval Ii. 

The standard result established by the next theorem is essential for our purpose. 

Theorem 1. ( [13], pp.111) Let 

A := {xj}^ 1 , iVeN, such that c = x < X\ < ■ ■ ■ < x^ < x^+i = d. (3) 
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Then 

S m (A) = spajx{l,x,...,x m - 1 ,(x-x i )^- 1 ,i = l,...,N}, 
where (x — Xi)™~ 1 — (x — Xi)' m ~ l for x — Xi > and otherwise. 

We are now ready to prove the theorem from which our proposal will naturally arise. 

Theorem 2. Suppose that Ai and A2 are two partitions of [c,d]. It holds to be true that 

S m (A 1 ) + S m (A 2 ) = S m (Ai U A 2 ). 

Proof. It stems from Theorem 1 and the basic result of linear algebra establishing that for A\ 
and A 2 two sets such that Si = span-f^} and S 2 = span{v4 2 }, one has Si + S 2 = span{AiU A 2 } . 
Certainly, from Theorem 1 and for 

Ai-.^{l,x,...,x m '\{x-x i )^\x i eA 1 } and A 2 := {1, x, . . . , x m ~\ (x -x^~\ x t G A 2 } 

we have: S m (Ai) = sp&n{Ai}, S m (A 2 ) = span{yl2}. Hence 

S m {Ai) + 5 m (A 2 ) = sp&n{AiUA 2 } 

= span{l, x, . . . , x m_1 , (x - Xi)™~ l ,Xi G Ai U A 2 } 

so that, using Theorem 1 on the right hand side, the proof is concluded. □ 

The next corollary is a direct consequence of the above theorem. 
Corollary 1. Suppose that Aj,j = 1, ... ,71 are partitions of [c, d\. Then 

S m (Ai) + ■ ■ ■ + S m (A n ) = S m (U^ =1 Aj). 

3 Building B-spline dictionaries 

Let us start by recalling that an extended partition with single inner knots associated with 
S m (A) is a set A = {yi}^ N such that 

y m+i = x u i = 1, . . . , N, xi < ■■■ <x N 

and the first and last m points yi < ■ ■ • < y m < c, d < y m+ N+i < • • ■ < U2m+N can be 
arbitrarily chosen. 

With each fixed extended partition A there is associated a unique B-spline basis for S m (A), 
that we denote as {B m j}T=i N ■ The B-spline B m j can be defined by the recursive formulae [13]: 



B hj (x) 



1, tj ^ x <C tj+i, 
0, otherwise, 



B m ,j{x) = — - — — — B m _i d (x) + Vj+m — —B m - lij+1 (x). 

Uj+rn-l — Uj Uj+m ~ Uj+1 

The following theorem paves the way for the construction of dictionaries for S m (A). We use 
the symbol # to indicate the cardinality of a set. 
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Theorem 3. Let Aj, j = l,...,n be partitions of [c,d] and A = U™ =1 Aj. We denote the 
B-spline basis for S m (Aj) as {B^ 2 \ : k — 1, . . . , m + #Aj}. Accordingly, a dictionary, V m (A : 
Uj =1 Aj), for S m (A) can be constructed as 

V m {A : U" =1 Aj) := V^ =l {B% : k = 1, . . . , m + #A i }, 

so as to satisfy 

span{P m (A : U" =1 A,)} = S m {A). 
When n = 1, T> m (A : A\) is reduced to the B-spline basis of S m (A). 

Proof. It immediately follows from Corollary [TJ Indeed, 

span{D m (A : U] =1 Aj)} = span{U? =1 {fl<£ fc : k = 1, . . . , m + #A J }} 

= ^ m (Ax) + • • • + S m (Ax) = ^(U^A,) = S m (A). 

□ 

Remark 1. Note that the number of functions in the above defined dictionary is equal to 
n ■ m + X]j=i i^^-j' which is larger than dimS' m (A) = m + #A. Hence, excluding the trivial 
case n = 1, the dictionary constitutes a redundant dictionary for S m (A). 

According to Theorem [3], to build a dictionary for S m (A) we need to choose ra-subpartitions 
Aj G A such that U" =1 Aj = A. This gives a great deal of freedom for the actual construction 
of a non-uniform B-spline dictionary. Fig. 1 shows some examples which are produced by 
generating a random partition of [0, 4] with 6 interior knots. From an arbitrary partition 

A := {0 = Xq < X\ < • ■ ■ < x 6 < x 7 = 4}, 

we generate two subpartitions as 

A x := {0 = Xq < Xi < £3 < £5 < £7 = 4}, A 2 := {0 = x < x 2 < x^ < x & < x 7 = 4} 

and join together the B-spline basis for A x (light lines in the right graphs of Fig. 1) and A 2 
(dark lines in the same graphs) 

Remark 2. As should be expected, the cardinal B-spline dictionaries introduced in [12] arise 
here as particular cases of the proposed construction. In order to show this we use A& to denote 
an equidistant partition of [c, d] with distance b between adjacent points such that (d -c)/5 £ Z, 
i.e., Ab is composed by the inner knots Xj = c + jb, j = 1, . . . , (d — c)/b. We also consider 
the partition Aj ^ with knots Xj = c + job + jb' , where b 1 jb G Z and jo is a fixed integer in 
[0, fe'/fe — 1]. Since U^^A^/ = A b , we can build a dictionary as 

V m (A b : U^A^,) = U^Bjjg : k = l,...,m + #A,, 6 ,}, 

where B^\, k = 1, . . . , m + #A J0 ^/ is the cardinal B-spline basis for the subspace determined 
by the partition Aj Qt y. This yields a cardinal B-spline dictionary as proposed in [12]. 
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Figure 1: Examples of bases (graphs on the left) and the corresponding dictionaries (right graphs) 
for a random partition A consisting of 6 interior knots. The top graphs correspond to linear B-splines 
(m = 2). The bottom graphs involve cubic B-splines (m = 4). The top left graph depicts the B-spline 
basis for «S < 2(A) whereas the right one depicts the B-spline dictionary T>2(A : Ai U A2) arising by 
merging the B-spline basis for S^Ai) and for £2^2) (light and dark lines, respectively). The bottom 
graphs have the same description as the top graphs, but correspond to 54(A) and X^A : Ai U A2). 

4 Application to sparse signal representation 

Given a signal, / say, we address now the issue of determining a partition A, and sub-partitions 
= 1, ... ,71, such that: a) U™ =1 Aj = A and b) the partitions are suitable for generating a 
sparse representation of the signal in hand. As a first step we propose to tailor the partition 
to the signal / by setting A taking into account the critical points of the curvature function of 
the signal, i.e., 

T == ft : ( (TZTyi ) '(') = "}■ 

Usually the entries in T are choosen as the initial knots of A. In order to obtain more knots 
we apply subdivision between consecutive knots in T thereby obtaining a partition A with the 
decided number of knots. 

Because most signals are processed with digital computers, one normally has to deal with 
a numerical representation of a signal in the form of sampling points. Thus, another problem 
to be addressed is how to compute the entries in T from the sequence of points f(kh),k = 
l,...,n, where h is the step length in the discretization. The algorithm below outlines a 
procedure for accomplishing the task. According to Theorem [31 in order to build a dictionary 
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Algorithm 1 Computing the partition A: T(f,l). 

Input: the interval [c, d], the discrete signal f(c + kh), k — 0, . . . , n, the subdivision level I. 
Output: The partition A. 
A = {} 

for k = 2 : n — 3 do 
for t = : 2 do 

df=(f((k + t+l)h)-f((k + t)h))/h 

ddf = (f((k + t + l)h) + f((k + t - l)h)) - 2f((k + t)h))/h 2 
ct = ddf /(l - # 2 ) 3/2 
end for 

if | Co | < |ci| and |ci| > [ C2 j then 
A = Au{c+(k + l)h} 

end if 
end for 
Set N = #A 
Set A = A U {c, d} 
Sort the entries in A: 

c = x < x\ < ■ ■ ■ < xn+i = d 

for k = : N do 

A = A U {x k + t(x k+1 - x k )/l : t = 1, — 1} 
end for 



for S m (A) we need to choose n-subpartitions Aj G A such that U™ =1 A^ = A. As an example we 
suggest a simple method for producing n-subpartitions Aj G A, which is used in the numerical 
simulations of the next section. Considering the partition A = {xo,xi, . . . ,xn+i} such that 
c = xo < X\ < ■ ■ ■ < xn + i = d, for each integer j in [1, n] we set 

Aj := {c, d} U {xk : k G [1, N] and k mod n = j — 1}, 

e.g. if N — 10 and n = 3, we have Ai = {c, X3, xq, Xg, d}, A 2 = {c,xi,X4,xj,xio,d} 
A 3 = {c, x 2 ,x 5 ,a; 8 ,d}. 

It is easy to see that the above defined partitions satisfy Uj =1 Aj = A. 

4.1 Numerical examples 

We produce here three examples illustrating the potentiality of the proposed dictionaries 
for achieving sparse representations by nonlinear techniques. The signal we consider are the 
following: 

• A chirp signal, fi = cos(27rx 2 ), x G [0, 8], plotted in the top left of Fig. 1. 

• A seismic signal /2 plotted in the top right graph of Fig. 1. This signal was taken from the 
WaveLab802 Toolbox. It is acknowledged there that the signal is distributed throughout 
the seismic industry as a test dataset. 

• A cosine function of random phase / 3 = cos(87nr + 4>{x)), where (f)(x) is the piecewise 
constant function depicted in the bottom right of Fig. 1. The left graph corresponds to 
the signal. 
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Figure 2: Chirp signal f\ = cos(27rx 2 ) (top left). Seismic signal f 2 (top right). Cosine signal 
fs = cos(87rx + 4>{x)) (bottom left) for the randomly generate phase <f>(x) plotted in the bottom right 
graph. The broken lines, indistinguishable from the continue lines representing test signals, are the 
resulting approximations up to error's norm toh = 0.01||/j||, i = 1,2,3. 

The three signals are to be approximated up to a tolerance toL. = 0.01||/j||, % — 1,2,3 for 
the norm of the approximation's error. 

We deal with the chirp signal f\ on the interval [0, 8], by discretizing it into L = 2049 samples 
and applying Algorithm 1 to produce the partition A = T(/i, 9). The resulting number of knots 
is 1162, which is enough to approximate the signal, by a cubic B-spline basis for the space, 
within the above specified precision toll. A dictionary ^(A : Uj^Aj) for the identical space 
is constructed by considering 10 subpartitions, which yield Ni = 1200 functions. 

The signal f% is a piece of L = 513 data. A partition of cardinality 511 is obtained as A = 
T(/i, 8) and the dictionary of cubic splines we have used arises by considering 3 subpartitions, 
which yields a dictionary P 4 (A : U| =1 Aj) of cardinality N 2 = 521. 

The signal is discretized into L = 2049 samples. The partition A = T(/i,43) produces 
732 knots. Using 26 subpartitions we build a dictionary ^(A : U^Aj) of N 3 = 782 linear 
B-spline functions. 

Denoting by a l n , n = 1, . . . , A r i the atoms of the ith-dictionary, we look now for the subsets 
of indices Tj, i — 1, 2, 3 of cardinality Ki, i — 1, 2, 3 providing us with a sparse representation 
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Table 1: Comparison of sparsity performance achieved by selecting atoms from the non-uniform bases 
and dictionaries for adapted spline space (1st and 2nd rows), dft (3rd row), cardinal wavelet bases 
and dictionaries (4th and 5th rows). 



Dictionaries 


K 1 (signal f ± ) 


K 2 (signal f 2 ) 


K 3 (signal / 3 ) 


Non-uniform spline basis 


1097 


322 


529 


Non-uniform spline dictionary 


173 


129 


80 


Discreet cosine transform 


263 


208 


669 


Cardinal Chui-Wang wavelet basis 


246 


201 


97 


Cardinal Chui-Wang wavelet dictionary 


174 


112 


92 



of the signals. In other words, we are interested in the approximations 

ft* = J>X, 1 = 1,2,3, 

such that 11//^ — < tolj, i — 1,2, 3, and the values i — 1, 2, 3 are satisfactory small for 
the approximation to be considered sparse. Since the problem of finding the sparsest solution 
is intractable, for all the signals we look for a satisfactory sparse representation using the same 
greedy strategy, which evolves by selecting atoms through stepwise minimization of the residual 
error as follows. 

i) The atoms are selected one by one according to the Optimized Orthogonal Matching 
Pursuit (OOMP) method [16] until the above defined tolerance for the norm of the residual 
error is reached. 

ii) The previous approximation is improved, without greatly increasing the computational 
cost, by a 'swapping refinement' which at each step interchanges one atom of the atomic de- 
composition with a dictionary atom, provided that the operation decreases the norm of the 
residual error [17]. 

iii) A Backward-Optimized Orthogonal Matching Pursuit (BOOMP) method [18] is applied 
to disregard some coefficients of the atomic decomposition, in order to produce an approxima- 
tion up to the error of stage i). The last two steps are repeated until no further swapping is 
possible. 

Let us stress that, if steps ii) and iii) can be executed at least once, the above strategy 
guarantees an improvement upon the results of OOMP. The gain is with respect to the number 
of atoms involved in the approximation for the given error's norm. 

The described technique is applied to all the non-orthogonal dictionaries we have considered 
for comparison with the proposed approach. The results are shown in Table 1. In the first 
column we place the dictionaries to be compared. These are: 1) the spline basis for the space 
adapted to the corresponding signal, as proposed in Sec 4. As already mentioned, for signals fi 
and /2 we use cubic B-splines and for signal fa the linear one. 2) The dictionary for the identical 
spaces consisting of functions of larger support. 3) The orthogonal cosine bases used by the 
discrete cosine transform (dct). 4) The semi-orthogonal cardinal Chui-Wang spline wavelet 
basis [19] and 5) the Chui-Wang cardinal spline dictionary for the same space [20]. For signals 
fi and /2 we use cubic spline wavelets and for signal f% linear spline wavelets. 

The last three columns of Table 1 display the number of atoms involved in the atomic 
decomposition for each test signal and for each dictionary. These numbers clearly show a 
remarkable performance of the approximation produced by the proposed non-uniform B-spline 
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dictionaries. Notice that whilst the non-uniform spline space is adapted to the corresponding 
signal, only the dictionary for the space achieves the sparse representation. Moreover the 
performance is superior to that of the Chui-Wang spline wavelet basis [19] even for signal f^, 
which was specially selected because, due to the abrupt edges delimiting the smooth lines, is 
very appropriate to be approximated by wavelets. It is also worth stressing that for signal f% and 
/2 the performance is similar to the cardinal Chui-Wang dictionary, which is known to render 
a very good representation for these signals [20]. However, whilst the Chui-Wang cardinal 
spline wavelet dictionaries introduced in [20] are significantly redundant with respect to the 
corresponding basis (about twice as larger) the non-uniform B-spline dictionaries introduced 
here contain a few more functions than the basis. Nevertheless, as the examples of this section 
indicate, the improvement in the sparseness of the approximation a dictionary may yield with 
respect to the B-spline basis is enormous. Still there is the issue of establishing how to decide 
on the number of subpartitions to be considered. For these numerical examples the number 
of subpartitions was fixed as the one producing the best result when allowing the number of 
subpartitions to vary within some range. It was observed that only for signal f'2 the optimum 
number of subpartitions produced results significantly better that all other values. Conversely, 
from signals f\ and f% some variations from the optimum number of subpartitions still produce 
comparable results. 

5 Conclusions 

Non-uniform B-spline dictionaries for adapted spline spaces have been introduced. The pro- 
posed dictionaries are built by dividing a given partition into subpartitions and merging the 
basis for the concomitant subspaces. The dictionary functions are characterized by having 
broader support than the basis functions for the identical space. The uniform B-spline dictio- 
naries proposed in [12] readily arise here as a particular case. 

The capability of the non-uniform B-spline dictionaries to produce sparse signal represen- 
tation has been illustrated by recourse to numerical simulations. Thus, we feel confident that 
a number of applications could benefit from this construction, e.g., we believe it could also 
be useful in Computer- Aided Geometry Design (CAGD), for reducing control points and for 
finding sparse knot sets of B-spline curves [21-23]. 
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